Method for motion-synchronized ar or vr entertainment experience

ABSTRACT

Systems and methods for synchronizing movement, such as the movement of a vehicle with an augmented reality (AR) or virtual reality (VR) story-telling or narrative experience is provided. For example, the AR or VR experience can be adapted to justify the movement of the vehicle based on trip criterion, such as a navigational path upon which the vehicle has embarked. Alternatively, trip criterion, such as the navigational path upon which the vehicle will embark, can be adapted to comport with one or more events of the AR or VR experience.

TECHNICAL FIELD

The present disclosure relates generally to augmented reality(AR)/virtual reality (VR) presentations.

DESCRIPTION OF THE RELATED ART

VR can refer to the creation of a fully immersive virtual world/spaceexperience that users may interact with. AR can refer to the blending ofVR elements and real life. For example, AR may involve providing a livedisplayed experience of a physical, real-world environment in which thereal-world elements are augmented by computer-generated sensory input.

BRIEF SUMMARY OF THE DISCLOSURE

In accordance with one embodiment, a computer-implemented methodcomprises presenting a simulated audio/visual (A/V) experience to apassenger of a vehicle. The computer-implemented method furthercomprises obtaining trip criterion relevant to the vehicle. Furtherstill, the computer-implemented method comprises adapting the simulatedA/V experience based upon the trip criterion.

In accordance with another embodiment, a computer-implemented methodcomprises receiving information regarding a simulated audio/visual (A/V)experience. The computer-implemented method further comprises generatingat least one of trip criterion and ride information to comport with oneor more events of the simulated A/V experience. Moreover, thecomputer-implemented method comprises presenting the simulated A/Vexperience in conjunction with the at least one of the trip criterionand ride information such that the at least one of the trip criterionand ride information corresponds to the simulated A/V experience.

In accordance with another embodiment, a system comprises a simulationdevice adapted to create a simulated augmented reality (AR)story-telling experience. The system further comprises at least onesensor adapted to at least one of generate and provide navigational andmotion information associated with a vehicle through which the simulatedAR experience is presented to the simulation device, and receiveinformation regarding the simulated AR story-telling experience, whereinthe simulated AR story-telling experience is synchronized with thenavigational and motion information associated with the vehicle.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure, in accordance with one or more variousembodiments, is described in detail with reference to the followingfigures. The figures are provided for purposes of illustration only andmerely depict typical or example embodiments.

FIG. 1A is an operational flow diagram illustrating an example processfor synchronizing a simulated AR or VR experience with motion inaccordance with one embodiment.

FIG. 1B is an operational flow diagram illustrating an example processfor synchronizing a simulated AR or VR experience with motion inaccordance with a second embodiment.

FIG. 2A illustrates an example motion-synchronized AR or VR experiencesystem in accordance with various embodiments.

FIG. 2B illustrates an example interface through which one or more userinputs or selections can be received for generating amotion-synchronized AR or VR experience in accordance with variousembodiments.

FIG. 3A illustrates an example event occurring in a motion-synchronizedAR or VR experience in accordance with a first implementation.

FIG. 3B illustrates the example event of FIG. 3A presented with analternative device in accordance with a second implementation.

FIG. 3C illustrates the example event of FIG. 3A presented with analternative device in accordance with a third implementation.

FIG. 4 is an example computing module that may be used to implementvarious features of embodiments described in the present disclosure.

The figures are not exhaustive and do not limit the present disclosureto the precise form disclosed.

DETAILED DESCRIPTION

Transportation can be a tedious activity for children, teenagers, andeven adults. An immersive entertainment experience provided during timesthat people are forced to spend going from one place to another, such asthe morning commute to school in a car or bus, a long road-trip, etc.would help to alleviate the tedious nature of travel. Additionally, asself-driving cars and augmented/virtual reality becomes more pervasive,those technologies can be leveraged to create better story-tellingexperiences.

Accordingly, various embodiments integrate procedurally generated AR/VRcreation with motion-based technologies (such as navigation,self-driving, and/or sensor-based technologies) to create an immersivestory-telling environment. This can be accomplished by linking orsynchronizing the actual motion of the vehicle and/or vehicleoccupant(s) to what the vehicle occupant(s) sees on a screen and/or isprojected onto a display or other viewing surface, such as a vehiclewindow (see FIG. 3A). As a result, any travel experience can be turnedinto an interactive narrative experience.

For example, a vehicle's motion-based system(s) can exchange tripcriterion as well as ride information with an AR or VR creation systemto generate one or more events justifying that trip criterion and/orride information in the context of a story-telling experience.Alternatively, the AR or VR creation system can create a narrative orstory-telling experience that can be shared with the vehicle'smotion-based system(s). The vehicle's motion-based system(s) may thengenerate trip criterion to which the vehicle adheres such that thetravel experience comports with the narrative or story-tellingexperience.

It should be noted that although various embodiments herein arepresented and described in the context of a vehicle, the vehicle cansimply be a mechanism through which AR or VR can be experienced. Thatis, the AR or VR creation system as well as one or more of thenavigation, self-driving, and/or sensor systems can reside within aseparate device, such as a smartphone, tablet PC, and the like.

FIGS. 1A, 1B, 2A, and 2B will be described in conjunction with eachother, where FIGS. 1A and 1B illustrate example processes performed inaccordance with various embodiments for generating an AR or VRstory-telling experience that is synchronized with vehicle movement.FIG. 2A is a block diagram of an example system providing avehicle-synchronized AR or VR experience in accordance with variousembodiments. FIG. 2B is a representation of an example interface throughwhich one or more user inputs/selections can be received for generatinga motion-synchronized AR or VR experience in accordance with variousembodiments.

At operation 100, a simulated audio/visual experience is presented to apassenger of a vehicle. A simulated A/V experience may refer to asimulated, recreational presentation conveyed to the vehicle passengerthrough various media. Such media may include one or more of visual,audio, haptic, and/or other media, where the visual, audio, haptic,and/or other media changes based on the motion of the vehicle asdescribed in greater detail below. A simulated, recreationalpresentation may include the presentation of simulation content. Thesimulation content may include one or more of a story, an image, avideo, a movie, an audio, a song, and/or other content. For example, asimulated experience may include a story relating to escaping zombies ina vehicle.

A vehicle may be any passenger conveyance, such as a bus, car, boat,glider, airplane, bicycle, motorcycle, etc. As alluded to previously,various embodiments are described in the context of a vehicle such as acar or bus, where the vehicle may have an associated motion-basedsystem, for example, an in-vehicle navigation system. However, otherembodiments do not require any vehicle-specific systems. Moreover,contemplated vehicles do not necessarily have to be embodied withparticular physical characteristics, such as windows or in-vehicleentertainment systems. That is, a motion-synchronized AR or VRexperience can be provided to a user having a device capable ofproviding an AR or VR experience, such as a head-mounted display, and adevice (which may be the same or different from that providing the AR orVR experience) that can provide motion-based information such as tripcriterion

Presentation of the simulated A/V experience can be accomplished by amotion-synchronized AR or VR system 200, such as that illustrated inFIG. 2A. System 200 may include one or more of a simulation device 202,a sensor 218, and a presentation (output) device 220. Some or allcomponents of system 200 may be installed in a vehicle and/or coupledwith a vehicle. Some or all components of system 200 may be worn or heldby a person. Some or all of components of system 200 may be installed ina device worn by a person in a vehicle and/or be otherwise coupled witha device worn by a person in a vehicle.

Presentation (output) device 220 may be configured to provide asimulation experience visually, audibly, haptically, and/or in otherways. Presentation device 220 may include one or more of a display, aspeaker, a light source, an air conditioner, a heater, a temperaturecontroller and/or other simulation devices.

A display may provide a simulation experience through visual informationpresented on the display. Visual information may include informationthat may be observed visually, such as an image, video, and/or othervisual information. A display may include one or more of an opticalhead-mounted display 308 (see FIG. 3B), a head-mounted display 310 inwhich simulation device 202 (or alternatively, presentation device 220)may be integrated (see FIG. 3C), a see-through display, an opticalsee-through display, a video see-through display, a visor, eyeglasses,sunglasses, a computer, a laptop, a smartphone, a tablet, a mobiledevice, a projector, and/or other displays.

In some implementations, a display may include motion, position, and/ororientation tracking component, so that the visual information presentedon the display changes as the position and/or orientation of the displaychanges. In some implementations, a display may be integrated with avehicle. For example, a display may include one or more of a dashboarddisplay, a global positioning system (GPS) navigation display, a frontview camera display (see FIG. 3A), a rear view camera display, a displayof a vehicle entertainment system and/or other displays such as aheads-up display projected on a window of the vehicle.

A display may be configured to display a simulation experience using ARor VR technology. For example, a display may visually provide thesimulation experience by displaying an overlay image over one or more ofan image, a video, and/or other visual information so that one or moreparts of a real-world objects appear to be augmented by one or moreparts of a virtual-world objects. In some implementations, a display mayuse AR or VR technology to display a simulation experience by usingsystems and methods described in U.S. patent application Ser. No.14/966,754, entitled “SYSTEMS AND METHODS FOR AUGMENTING AN APPEARANCEOF AN ACTUAL VEHICLE COMPONENT WITH A VIRTUAL VEHICLE COMPONENT,” filedDec. 11, 2015, the foregoing being incorporated herein by reference inits entirety. Other systems and methods of providing a simulationexperience are contemplated.

A speaker may provide a simulation experience through audio informationgenerated by the speaker. Audio information may include information thatmay be observed audibly. Audio information may include one or more ofsound, vibration and/or other audio information. A speaker may includeone or more of a headphone, an earphone, a headset, an earset, and/orother speakers. In some implementations, a speaker may include a speakerassociated with a display. For example, a speaker may include a speakerof a mobile device. In some implementations, a speaker may be integratedwith a vehicle. For example, a speaker may include a sound system of avehicle.

A light source may provide a simulation experience through one or morewavelengths and/or intensities of light. A light source may include anelectric lighting, a fluorescent lighting, an incandescent lighting, aninfrared lighting, a light-emitting diode, and/or other light sources.In some implementations, a light source may include a light source of amobile device. In some implementations, a light source may be integratedwith a vehicle. For example, a light source may include one or moreinterior light sources of a vehicle.

Referring back to FIG. 1A, trip criterion relevant to the vehicle isobtained. A trip criterion may refer to one or more physical and/ortemporal characteristics of a trip. By way of example, a trip criterionmay include, but is not limited to, one or more information relating tothe trip destination, the distance of the trip, the duration of thetrip, the path to a trip destination, the locations along the trip,and/or other information relating to the trip. A trip criterion may beobtained based on one or more user inputs received through one or moreinput devices, and/or from one or more navigation devices.

At operation 104, the simulated A/V experience is adapted based upon thetrip criterion such that the simulated A/V experience justifies the tripcriterion. That is, simulation device 202 would adapt the simulated A/Vexperience to include, e.g., a story experience, element, event, oraction, that would be justified in the narrative. To accomplish thissynchronization between motion and the simulated AR or VR experience,simulation device 202 may be configured to execute one or more computerprogram components. The computer program components may include one ormore of a simulation experience component 204, a simulation informationcomponent 206, a ride information component 208, a simulation eventoccurrence component 210, a simulation stimuli generation component 212,a simulation provision component 214, and/or other components.

Simulation experience component 204 may be configured to select asimulated experience or overall story theme or narrative. A simulationexperience may be selected based on a trip criterion. It should be notedthat a simulation experience may also be selected based upon a userselection, a prior simulated experience, and/or other information.Simulation experience component 204 may include or retrieve information(for example, a database, etc.) that matches one or more of a tripcriterion, a user selection, a prior simulated experience, and/or otherinformation relating to a particular simulation experience.

In some implementations, simulation experience component 204 may selecta simulated experience based on a trip destination. For example,simulation experience component 204 may match a trip destination of ahome to a simulation experience relating to space travel to a home base,a home planet, or a home ship as part of the narrative presented in thesimulated AR or VR experience. In some implementations, simulationexperience component 204 may select a simulated experience based on adistance of a trip. A distance of a trip may refer to a distance of oneor more parts of the trip. For example, simulation experience component204 may match a short distance of a trip to a simulation experiencerelating to a space race to a nearby object/location. In someimplementations, simulation component 204 may select a simulationexperience so that a story of the simulation experience reaches its peakwhen the vehicle is estimated to be at a certain location in the trip.For example, simulation experience component 204 may select a simulationexperience so that a story of the simulation experience will reach itspeak when the vehicle is expected to have traveled a certain percentage(e.g., 70%) of the distance of the trip.

In some implementations, simulation experience component 204 may selecta simulated experience based on a duration of a trip. A duration of atrip may refer to a duration of one or more parts of a trip. Forexample, simulation experience component 204 may match a long durationof a trip to a simulation experience relating to a long space battle. Insome implementations, simulation component 204 may select a simulationexperience so that a story of the simulation experience reaches its peakwhen the vehicle is estimated to have a certain duration remaining inthe trip.

In some implementations, simulation experience component 204 may selecta simulated experience based on a location along a trip. A locationalong a trip may refer to a location along one or more parts of a trip.As non-limiting examples, simulation experience component 204 may matchan urban area along a trip to a simulation experience in a virtual city.

In some implementations, a trip criterion may be obtained from one ormore navigation systems or devices. A navigation device may refer to adevice that keeps track of a location of a vehicle on a trip. Forexample, a navigation device may include a navigation/GPS system of avehicle and/or a navigation/GPS system coupled to simulation device 202.As another example, a navigation device may include or be implemented ina mobile device such as a smart phone. Simulation experience component204 may obtain, from one or more navigation devices, one or more of atrip destination, a distance of a trip, a duration of a trip, a locationalong a trip, a path along the trip or to the trip destination, and/orother information relating to a trip.

A simulation experience may also be selected based on a user selection.FIG. 2B illustrates an example user interface 230 through which one ormore user inputs/selections 234 may be received. The example userinterface 230 may be presented on simulation device 202 or otherdevices. Various options can be presented to allow a user to tailor theexperience to his/her desires or needs. As discussed herein, an AR or VRexperience can be generated such that is corresponds to or justifies oneor more events that may occur over the course of a route to a particulardestination. To achieve this synchronization, the user, through theselection of trip criterion 232 may opt to connect to a navigationsystem, input a route, or select a previously traveled route. The usermay further specify one or more preferences, whether applicable to aparticular route or related to the user's experience, such as howimmersive the user desired the AR or VR experience to be.

A user selection may include a selection of a simulation experiencebased on one or more user inputs received through one or more inputdevices. A simulation experience may alternatively be selected based ona prior simulated experience. A prior simulated experience may refer toone or more simulated experiences previously presented to a user.Information regarding a prior simulation experience may be obtained froma memory of system 200 and/or a memory otherwise coupled to system 200.For example, information regarding a prior simulation experience mayindicate that the prior simulation experience was not concluded. In someimplementations, simulation component 204 may select the prior simulatedexperience and continue the presentation of that prior simulationexperience.

Simulation Information component 206 may be configured to obtainsimulation information for the simulation experience. The simulationinformation may include one or more of a database, a lookup table,and/or other information component that allows simulation informationcomponent 206 to match a simulation event to a simulation stimulus. Asimulation event may refer to one or more of specific motions, specificactions, specific sounds, specific locations, specific surroundings,and/or other specific conditions relating to a vehicle and/or a personin the vehicle. A simulation stimulus may refer to one or more of avisual, an audio, a haptic and/or other simulation that may change asimulation experience. The simulation information may be programmed intosimulation information component 206, updated by simulation informationcomponent 206, obtained by simulation information component 206 fromelectronic storage, obtained by simulation information component 206from a remote location, and/or obtained by simulation informationcomponent 206 in other ways.

The simulation information may include simulation stimuli thatcorrespond to simulation events. The simulation stimuli may include afirst simulation stimulus that corresponds to a first simulation event.For example, a particular simulation stimulus (e.g., a virtual vehiclejumping into light speed/a virtual vehicle hitting an obstacle) maycorrespond to a particular motion of a vehicle (e.g.,accelerating/breaking). As another example, a particular simulationstimulus (e.g., a virtual location shaking and/or virtual objectsfalling/moving) may correspond to a particular activity inside a vehicle(e.g., high volume and/or intensity of physical activity inside avehicle). As another example, a particular simulation stimulus (e.g.,the size, shape, and/or angle of a virtual object changing and/orspecific actions taken by a virtual object, such as communicating orfiring a weapon) may correspond to a particular location of a vehicle(e.g., distance from a destination or duration to a destination). Asanother example, a particular simulation stimulus (e.g., virtual rain ina virtual location) may correspond to a particular environment around avehicle (e.g., rain). Other simulation stimulus and simulation eventsare contemplated.

Ride information component 208 may be configured to obtain rideinformation. Ride information may characterize one or more aspects of aride. The aspects of the ride may include a setting of the ride,operation of the vehicle, user interaction or reaction within thevehicle, and/or other aspects. Without limitation, ride information mayinclude motion, action, sound, location, surroundings, and/or otherinformation relating to a vehicle and/or a person in the vehicle. Rideinformation may be obtained from output signals generated by sensor 218.

Sensor 218 may include one or more of image sensors, temperaturesensors, vehicle speed sensors, wheel speed sensors, motion sensors,accelerometers, tilt sensors, inclination sensors, angular rate sensors,gyroscopes, navigation sensors, geolocation sensors, magnetometers,radar detectors, radar sensors, proximity sensors, distance sensors,vibration sensors, light detection sensors, vehicle sensors, enginecontrol module sensors, and/or other sensors. In some implementationsthe aforementioned navigation system/device may be thought of orembodied as a sensor). In some implementations, sensor 218 may beinstalled in a vehicle and/or be otherwise coupled to a vehicle. In someimplementations, sensor 218 may be worn by a person in a vehicle. Insome implementations, sensor 218 may be installed in or otherwisecoupled to simulation device 202.

Ride information may include motion information. Motion information maycharacterize a motion experience by a person in a vehicle at a time,over a duration of time, at a location, or over a distance. Motioninformation may include one or more information regarding motionexperienced by a person in a vehicle, including one or more of movingforward, moving backwards, moving right, moving left, moving up, movingdown, turning left, turning right, sloping up, sloping down,acceleration in any direction and/or angle, deceleration in anydirection and/or angle, jostling, hitting a speedbump, hitting apothole, and/or other motion information. Simulation device 202 mayobtain motion information from output signals generated by sensor 218.In some implementations, sensor 218 may include one or more of a vehiclespeed sensor, a wheel speed sensor, a motion sensor, an accelerometer, atilt sensor, an inclination sensor, an angular rate sensor, a gyroscope,a magnetometer, a vibration sensor, a vehicle sensor, an engine controlmodule sensor, and/or other sensors.

In some implementations, ride information may include activityinformation. Activity information may characterize an action performedand/or a sound made by a person or other object in a vehicle at a time,over a duration of time, at a location, or over a distance. Activityinformation may include one or more information regarding activity of aperson in a vehicle, including one or more of quantity and/or quality ofaction and/or sound made by the person, and/or other activityinformation. Simulation device 202 may obtain activity information fromoutput signals generated by sensor 218. In some implementations, sensor218 may include one or more of an image sensor that characterizes anaction performed by a person in the vehicle, a sound sensor thatcharacterizes a sound made by a person in the vehicle, a wearable sensorthat characterizes an action performed and/or a sound made by a personin the vehicle, and/or other sensors. Moreover, sensor 218 may also beused to customize or personalize presentation of the simulated A/Vexperience to the user or users in accordance with various embodimentsbased on activity information. For example, in vehicle with multiplewindows, presentation of one or more AR or VR elements may be optimizedfor the best viewing angle by the user or users in the vehicle.

In some implementations, ride information may include trip progressinformation. Trip progress information may characterize a location of avehicle along a trip, a distance traveled in a trip, a distanceremaining in a trip, a duration traveled in a trip and/or a remainingexpected duration of a trip. Trip progress information may include oneor more information regarding a status of a trip, including one or moreof location of a vehicle, a traveled distance, a remaining distance, atraveled duration, an expected remaining duration, and/or other tripprogress information. Simulation device 202 may obtain trip progressinformation from output signals generated by sensor 218. In someimplementations, sensor 218 may include one or more of a navigationsensor, a geolocation sensor, a magnetometer, a vehicle sensor, anengine control module sensor, and/or other sensors.

In some implementations, ride information may include environmentinformation. Environment information may characterize a condition of anenvironment around a vehicle at a time, over a duration of time, at alocation, or over a distance. Environment information may include one ormore of information regarding a condition of an environment around avehicle, including one or more of time, weather, temperature, humidity,lighting, and/or other environment information. Simulation device 202may obtain environment information from output signals generated bysensor 218. In some implementations, sensor 218 may include one or moreof a clock, an image sensor, a temperature sensor, a vibration sensor, alight detection sensor, a vehicle sensor, an engine control modulesensor, and/or other sensors. In some implementations, simulation device202 may obtain environment information by determining a location of avehicle from output signals generated by sensor 218 and obtainingenvironment information at the location from a communication device.

Simulation event occurrence component 210 may be configured to identifyoccurrences of simulation events based on ride information. A simulationevent may refer to one or more of specific motions, specific actions,specific sounds, specific locations, specific surroundings, and/or otherspecific conditions relating to a vehicle and/or a person in thevehicle. Occurrences of simulation events may be identified based on oneor more of motion information, activity information, trip progressinformation, environment information, caravanning information, and/orother ride information. Simulation event occurrence component 210 may beconfigured to identify an occurrence of a simulation event when one ormore of motion information, activity information, trip progressinformation, environment information, and/or other ride informationindicates occurrence of one or more of specific motions, specificactions, specific sounds, specific locations, specific surroundings,and/or other specific conditions relating to a vehicle and/or a personin the vehicle that correspond to a specific simulation event.

Criteria for an occurrence of one or more simulation events may bereferred to as a simulation event logic. The simulation event logic maybe programmed into simulation event occurrence component 210, updated bysimulation event occurrence component 210, obtained by simulation eventoccurrence component 210 from the simulation information, obtained bysimulation event occurrence component 210 from memory, obtained bysimulation event occurrence component 210 from a remote location, and/orobtained by simulation event occurrence component 210 in other ways.

Simulation stimulation generation component 212 may be configured togenerate simulation stimuli that correspond to simulation events forwhich occurrences are identified. A simulation stimulus may refer to oneor more of a visual, an audio, a haptic and/or other simulation that maychange a simulation experience. Simulation stimulation generationcomponent 212 may be configured to generate a simulation stimulus for asimulation event when the simulation stimulus corresponding to thesimulation event is found in the simulation information.

Simulation provision component 214 may be configured to effectuateprovision of a simulated experience by operating simulation devicepresentation (output) device 220. Presentation (output) device 220 mayinclude one or more of a display, a speaker, a light source, an airconditioner, a heater, a temperature controller and/or other simulationdevices. Simulation provision component 214 may be configured toeffectuate provision of a simulated experience through one or more ofvisual, audio, haptic and/or other simulation, where the visual, audio,haptic, and/or other simulation changes based on simulation stimuli.

For example, FIG. 3A illustrates a motion-synchronized simulated AR orVR experience provided by system 200. In FIG. 3A, the simulationexperience relates to escaping zombies in a virtual post-apocalypticworld. In this example, simulation event occurrence component 210 mayselect a simulated experience based upon one or more aspects along thepath to the trip destination gleaned from trip criterion obtained fromsensor 218. Simulation event occurrence component 204 may matchnavigational turns along the identified path to evade zombies. It may bedetermined (also by sensor 218) that the optimal display of the ARzombies 306 to be avoided is on the front windshield 304 of vehicle 300.Prior to where the trip criterion (and/or ride information) indicatesthat vehicle 300 should complete a left turn on road 302, AR zombies arepresented to the vehicle passenger. In this example, presentation device220 may be a heads-up display projector projecting images of the ARzombies 306 on front windshield 304. Thus, the left turn would bejustified in the narrative of escaping zombies.

It should be noted that the number and/or timing of aspects chosen canvary. Simulation event occurrence component 210 can be configured and/oroptimized to identify and select simulated events based on any of theaforementioned criteria/considerations (see FIG. 2B). For example, basedon the duration of a trip, the number of simulated events can beincreased or decreased. Moreover, a user may be able to select howimmersive the simulated AR or VR experience should be, whether moreimmersive, i.e., more simulated event occurrences are presented, or lessimmersive, i.e., less simulated event occurrences are presented.Additionally, the timing of the presentation of AR events or activitiescan also be configured. For example, simulation event occurrencecomponent 210 can be configured to present AR events or activities 2, 3,5, 10 seconds before, or substantially at the time an actual trip eventor action in the trip criterion or ride information is to occur.Moreover, one or more components of simulation device 202 can beconfigured to update their respective simulation processes based onchanges in traffic/environmental conditions. Additionally still, inputfrom one or more users can cause the one or more components ofsimulation device 202 to adapt and/or adjust the trip criterion and/orride information accordingly.

In accordance with another embodiment, instead of justifying tripcriterion and/or ride information with the simulated AR or VR experience(i.e., synchronizing the AR or VR experience to the trip), the narrativeor story of the simulated AR or VR experience can influence the tripcriterion/ride information. For example, a story or narrative to bepresented via a simulated AR or VR experience can be developed withcertain pre-determined events that require a kinetic response. Forexample, a narrative where a vehicle engine stalls may require theactual vehicle to slow down and stop.

Accordingly, simulation device 202 and its respective components can actin reverse. For example, a digital representation of the narrative maybe input into simulation device 202. Referring to FIG. 1B, at operation110, information regarding a simulated A/V experience is received. Thevarious components, e.g., simulation experience component 204,simulation information component 206, ride information component 208,simulation event occurrence component 210, simulation stimuli generationcomponent 212, and/or simulation provision component 214 may parse thedigital representation of the narrative.

Parsing the digital representation of the narrative is done to obtainrelevant information that may then be used to direct one or more ofsensors 218 (e.g., the in-vehicle navigation system) and presentationdevice 220 to react accordingly. Referring again to FIG. 1B, atoperation 112, at least one of trip criterion and ride information isgenerated to comport with one or more events of the simulated A/Vexperience. In response, the navigation system, for example, finds anappropriate place to slow down and stop to correspond to the narrative.If nothing is available, the simulation device 202 may update or adaptthe narrative to match actual environmental conditions. It should benoted that system 200 can act in real-time, near real-time, or providethe narrative prior to the trip so that a route can be pre-plotted viathe in-vehicle navigation system, for example. Thus, at operation 114,the simulated A/V experience can be presented in conjunction with the atleast one of the trip criterion and ride information such that the atleast one of the trip criterion and the ride information justifies thesimulated A/V experience.

FIG. 2B illustrates the ability of the user to enter story criterion 236using one or more options/selections 238 through user interface 230. Ina scenario where the user wishes to tailor a trip to a pre-establishedstory or narrative, the user may input a story or narrative,select/continue a previous AR or VR story experience, and enter storypreferences. For example, the user may select only certain aspects of astory to which a generated trip or route should correspond. Similar tothe previous embodiment, the user may enter or select route preferencesand experience preferences to further customize and/or enhance the AR orVR experience.

Many different applications are contemplated herein. Various embodimentscan be leveraged in amusement parks with the busses or monorail systemsturning transportation into entertainment. For example, a customer beingpicked up by a bus could start an AR or VR experience (which could beunique based on their seat/window or a shared experience with the restof the passengers, as well as a voluntary option requiring activation bythe customer). Moreover, and in the case of multiple passengers, the ARor VR experience can be customized to each of the multiple passengersand/or shared depending upon variables such as where each particularpassenger is seated/how they are oriented, consumption of prior AR or VRexperiences, personal preferences relating to media presented in the ARor VR experience, etc. Users looking out the window of the bus may see astar scape as if they were in space, and as the bus accelerates, bepresented with the visuals and sounds of accelerating into lightspeed.Simulation device 202 would then receive information relating to stops(either before or as they happen) and generate battles and asteroidsthat justify those movements along the drive from the parking lot to thepark. These stories could either be stand-alone stories or linkedtogether (e.g., contextually) like episodes to form longer term storytelling experiences that may also be updatable based upon what thecustomer(s) may have previously experienced. It should be noted that inthe case of multiple users/passengers, a single system 200 may beutilized, where sensor 218 can be responsible for acquiring informationabout each user/passenger, or multiple instances of system 200 can beimplemented in a vehicle.

FIG. 4 illustrates an example computing module that may be used toimplement various features of the system and methods disclosed herein,for example, one or more elements of system 200, such as simulationdevice 202, and presentation (output) device 220.

As used herein, the term module might describe a given unit offunctionality that can be performed in accordance with one or moreembodiments of the present application. As used herein, a module mightbe implemented utilizing any form of hardware, software, or acombination thereof. For example, one or more processors, controllers,ASICs, PLAs, PALs, CPLDs, FPGAs, logical components, software routinesor other mechanisms might be implemented to make up a module. Inimplementation, the various modules described herein might beimplemented as discrete modules or the functions and features describedcan be shared in part or in total among one or more modules. In otherwords, as would be apparent to one of ordinary skill in the art afterreading this description, the various features and functionalitydescribed herein may be implemented in any given application and can beimplemented in one or more separate or shared modules in variouscombinations and permutations. Even though various features or elementsof functionality may be individually described or claimed as separatemodules, one of ordinary skill in the art will understand that thesefeatures and functionality can be shared among one or more commonsoftware and hardware elements, and such description shall not requireor imply that separate hardware or software components are used toimplement such features or functionality.

Where components or modules of the application are implemented in wholeor in part using software, in one embodiment, these software elementscan be implemented to operate with a computing or processing modulecapable of carrying out the functionality described with respectthereto. One such example computing module is shown in FIG. 4. Variousembodiments are described in terms of this example-computing module 400.After reading this description, it will become apparent to a personskilled in the relevant art how to implement the application using othercomputing modules or architectures.

Referring now to FIG. 4, computing module 400 may represent, forexample, computing or processing capabilities found within aself-adjusting display, desktop, laptop, notebook, and tablet computers;hand-held computing devices (tablets, PDA's, smart phones, cell phones,palmtops, etc.); workstations or other devices with displays; servers;or any other type of special-purpose or general-purpose computingdevices as may be desirable or appropriate for a given application orenvironment. Computing module 400 might also represent computingcapabilities embedded within or otherwise available to a given device.For example, a computing module might be found in other electronicdevices such as, for example navigation systems, portable computingdevices, and other electronic devices that might include some form ofprocessing capability.

Computing module 400 might include, for example, one or more processors,controllers, control modules, or other processing devices, such as aprocessor 404. Processor 404 might be implemented using ageneral-purpose or special-purpose processing engine such as, forexample, a microprocessor, controller, or other control logic. In theillustrated example, processor 404 is connected to a bus 402, althoughany communication medium can be used to facilitate interaction withother components of computing module 400 or to communicate externally.

Computing module 400 might also include one or more memory modules,simply referred to herein as main memory 408. For example, preferablyrandom access memory (RAM) or other dynamic memory, might be used forstoring information and instructions to be executed by processor 404.Main memory 408 might also be used for storing temporary variables orother intermediate information during execution of instructions to beexecuted by processor 404. Computing module 400 might likewise include aread only memory (“ROM”) or other static storage device coupled to bus402 for storing static information and instructions for processor 404.

The computing module 400 might also include one or more various forms ofinformation storage mechanism 410, which might include, for example, amedia drive 412 and a storage unit interface 420. The media drive 412might include a drive or other mechanism to support fixed or removablestorage media 414. For example, a hard disk drive, a solid state drive,a magnetic tape drive, an optical disk drive, a compact disc (CD) ordigital video disc (DVD) drive (R or RW), or other removable or fixedmedia drive might be provided. Accordingly, storage media 414 mightinclude, for example, a hard disk, an integrated circuit assembly,magnetic tape, cartridge, optical disk, a CD or DVD, or other fixed orremovable medium that is read by, written to or accessed by media drive412. As these examples illustrate, the storage media 414 can include acomputer usable storage medium having stored therein computer softwareor data.

In alternative embodiments, information storage mechanism 410 mightinclude other similar instrumentalities for allowing computer programsor other instructions or data to be loaded into computing module 400.Such instrumentalities might include, for example, a fixed or removablestorage unit 422 and an interface 420. Examples of such storage units422 and interfaces 420 can include a program cartridge and cartridgeinterface, a removable memory (for example, a flash memory or otherremovable memory module) and memory slot, a PCMCIA slot and card, andother fixed or removable storage units 422 and interfaces 420 that allowsoftware and data to be transferred from the storage unit 422 tocomputing module 400.

Computing module 400 might also include a communications interface 424.Communications interface 424 might be used to allow software and data tobe transferred between computing module 400 and external devices.Examples of communications interface 424 might include a modem orsoftmodem, a network interface (such as an Ethernet, network interfacecard, WiMedia, IEEE 802.XX or other interface), a communications port(such as for example, a USB port, IR port, RS232 port Bluetooth®interface, or other port), or other communications interface. Softwareand data transferred via communications interface 424 might typically becarried on signals, which can be electronic, electromagnetic (whichincludes optical) or other signals capable of being exchanged by a givencommunications interface 424. These signals might be provided tocommunications interface 424 via a channel 428. This channel 428 mightcarry signals and might be implemented using a wired or wirelesscommunication medium. Some examples of a channel might include a phoneline, a cellular link, an RF link, an optical link, a network interface,a local or wide area network, and other wired or wireless communicationschannels.

In this document, the terms “computer program medium” and “computerusable medium” are used to generally refer to transitory ornon-transitory media such as, for example, memory 408, storage unit 420,media 414, and channel 428. These and other various forms of computerprogram media or computer usable media may be involved in carrying oneor more sequences of one or more instructions to a processing device forexecution. Such instructions embodied on the medium, are generallyreferred to as “computer program code” or a “computer program product”(which may be grouped in the form of computer programs or othergroupings). When executed, such instructions might enable the computingmodule 400 to perform features or functions of the present applicationas discussed herein.

Although described above in terms of various exemplary embodiments andimplementations, it should be understood that the various features,aspects and functionality described in one or more of the individualembodiments are not limited in their applicability to the particularembodiment with which they are described, but instead can be applied,alone or in various combinations, to one or more of the otherembodiments of the application, whether or not such embodiments aredescribed and whether or not such features are presented as being a partof a described embodiment. Thus, the breadth and scope of the presentapplication should not be limited by any of the above-describedexemplary embodiments.

Terms and phrases used in this document, and variations thereof, unlessotherwise expressly stated, should be construed as open ended as opposedto limiting. As examples of the foregoing: the term “including” shouldbe read as meaning “including, without limitation” or the like; the term“example” is used to provide exemplary instances of the item indiscussion, not an exhaustive or limiting list thereof; the terms “a” or“an” should be read as meaning “at least one,” “one or more” or thelike; and adjectives such as “conventional,” “traditional,” “normal,”“standard,” “known” and terms of similar meaning should not be construedas limiting the item described to a given time period or to an itemavailable as of a given time, but instead should be read to encompassconventional, traditional, normal, or standard technologies that may beavailable or known now or at any time in the future. Likewise, wherethis document refers to technologies that would be apparent or known toone of ordinary skill in the art, such technologies encompass thoseapparent or known to the skilled artisan now or at any time in thefuture.

The presence of broadening words and phrases such as “one or more,” “atleast,” “but not limited to” or other like phrases in some instancesshall not be read to mean that the narrower case is intended or requiredin instances where such broadening phrases may be absent. The use of theterm “module” does not imply that the components or functionalitydescribed or claimed as part of the module are all configured in acommon package. Indeed, any or all of the various components of amodule, whether control logic or other components, can be combined in asingle package or separately maintained and can further be distributedin multiple groupings or packages or across multiple locations.

Additionally, the various embodiments set forth herein are described interms of exemplary block diagrams, flow charts and other illustrations.As will become apparent to one of ordinary skill in the art afterreading this document, the illustrated embodiments and their variousalternatives can be implemented without confinement to the illustratedexamples. For example, block diagrams and their accompanying descriptionshould not be construed as mandating a particular architecture orconfiguration.

1. A computer-implemented method, comprising: presenting a simulatedaudio/visual (NV) experience to a passenger of a vehicle; obtaining tripcriterion relevant to the vehicle; and adapting the simulated A/Vexperience based upon the trip criterion, wherein the simulated A/Vexperience comprises an augmented reality (AR) story-telling narrative.2. The computer-implemented method of claim 1, wherein the tripcriterion comprises a path to at least one destination.
 3. (canceled) 4.The computer-implemented method of claim 1, wherein the adaptation ofthe simulated A/V experience comprises presenting one or more ARelements in the context of the AR story-telling narrative that comportswith one or more events identified in the trip criterion.
 5. Thecomputer-implemented method of claim 1, wherein the trip criterion isobtained from at least one of a navigation system and a sensor.
 6. Thecomputer-implemented method of claim 5, wherein the navigation systemcomprises one of an in-vehicle navigation system or a navigation systemimplemented remotely from the vehicle.
 7. The computer-implementedmethod of claim 1, further comprising obtaining ride informationregarding at least a movement or orientation associated with thepassenger.
 8. The computer-implemented method of claim 7, wherein theadaptation of the simulated A/V experience comprises customizing thepresentation of the simulated A/V experience for the passenger basedupon the ride information.
 9. The computer-implemented method of claim1, wherein the simulated A/V experience is one of plurality of simulatedAN experiences that are contextually linked.
 10. A computer-implementedmethod, comprising: receiving information regarding a simulatedaudio/visual (NV) experience; generating at least one of trip criterionand ride information to comport with one or more events of the simulatedAN experience; and presenting the simulated AN experience in conjunctionwith the at least one of the trip criterion and ride information suchthat the at least one of the trip criterion and ride informationcorresponds to the simulated AN experience, wherein the simulated A/Vexperience comprises an augmented reality (AR) story-telling narrative.11. The computer-implemented method of claim 10, wherein the tripcriterion comprises a path to at least one destination, and wherein theride information comprises at least one of a movement and orientation ofat least one user.
 12. (canceled)
 13. The computer-implemented method ofclaim 10, wherein the AR story-telling narrative is developed withpre-determined events requiring a kinetic response.
 14. Thecomputer-implemented method of claim 13, further comprising parsing adigital representation of the AR story-telling narrative to extract thepre-determined events requiring the kinetic response.
 15. Thecomputer-implemented method of claim 13, further comprising adapting thesimulated A/V experience in the event that the at least one of the tripcriterion and the ride information cannot meet at least one kineticresponse requirement associated with the pre-determined events.
 16. Asystem, comprising: a simulation device adapted to create a simulatedaugmented reality (AR) story-telling experience; and at least one sensoradapted to at least one of generate and provide navigational and motioninformation associated with a vehicle through which the simulated ARexperience is presented to the simulation device, and receiveinformation regarding the simulated AR story-telling experience, whereinthe simulated AR story-telling experience is synchronized with thenavigational and motion information associated with the vehicle.
 17. Theapparatus of claim 16, wherein the simulation device updates thesimulated AR story-telling experience based upon changes to thenavigational and motion information in real-time or near real-time. 18.The apparatus of claim 16, wherein the synchronization of the simulatedAR story-telling experience with the navigational and motion informationcomprises at least one of justifying the simulated AR story-tellingexperience with the navigational and motion information, and justifyingthe navigational and motion information with the simulated ARstory-telling experience.
 19. The apparatus of claim 16, wherein thesimulation device customizes the simulated AR story-telling experiencefor each of at least one passenger in the vehicle.
 20. The apparatus ofclaim 16, wherein the simulated AR story-telling experience is a portionof a broader story-telling experience.